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METHOD AND SYSTEM FOR CONNECTING TO A PROXY SERVER WITH THE 
LOWEST WORKLOAD THROUGH A LOAD BALANCING PROXY SERVER 



5 TECHNICAL FIELD 

The present invention generally relates to Internet Protocol (IP) telephony 
and, more specifically, relates to a method and system for connecting to a 
proxy server with the lowest workload through querying a load balancing proxy 
server. 

10 

BACKGROUND ART 

IP telephony is a collection of technologies that emulates and extends 
today's circuit-switched telecommunications services to operate on packet- 
switched data networks based on the Internet Protocol (IP). IP telephony 
,15 encompasses the terms "Internet Telephony", "voice-over-IP" (VoIP), "video- 
- over-IP", and "fax-over-IP", and extends those capabilities even further to 
t include new telecommunications applications made possible by the 

convergence of voice, video and data. "Voice-over-IP" (VoIP) technology 
enables the real-time transmission of voice signals as packetized data over "IP 
20 networks" that employ the Transmission Control Protocol (TCP), Real-Time 

Transport Protocol (RTP), User Datagram Protocol (UDP), and Internet Protocol 
(IP) suite, for example. 

A conventional Public Switched Telephone Network (PSTN) provides its 
users with dedicated, end-to-end circuit connections for the duration of each 
25 call. Based on the calling and called parties' numbers, circuits are reserved 
among an originating switch, any tandem switches along the route between 
the two ends of the call, and a terminating switch. Signaling between these 
PSTN switches supports basic call setup, call management, and call teardown 
as well as querying of databases to support advanced services such as local 
30 number portability, mobile subscriber authentication and roaming, virtual private 
networking, and toll-free service. 

The conventional PSTN has served voice traffic well over the last 1 00 
years, but its success has been paralleled by a rise of separate networks to 
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support data traffic. These separate networks include, for example, the World- 
Wide Web which is commonly referred to as the internet, an Intranet, a wide- 
area network (WAN), a local area network (LAN), an ATM, a T1 network, an 
El network, an Ethernet, a microwave network, a satellite network or the like, 
5 or a combination thereof. Clearly, use of distinct networks for voice and data 
represents an additional burden to service providers and an additional cost to 
consumers. As more and more PSTN traffic becomes data-oriented, however, 
the trend toward voice and data network convergence becomes stronger and 
stronger. Service providers, Internet service providers, and manufacturers of 
10 switching, transmission, and customer premises equipment are all participating 
in a significant shift of the telecommunications industry toward combined 

n voice/video/data networking using IP. 

The shift to IP telephony promises better efficiencies in the transport of 

P voice and data, and, as a result, lower telecommunications costs to end users. 

fyl 5 Moreover, as IP telephony evolves, it will be able to match all the features of 
voice communications currently supported by the PSTN. Interoperability 

if among the IP telephony products of different vendors is the first major hurdle 

fU to overcome. The real promise of IP telephony, however, will be realized with 

5 the next wave of advanced services that will begin to surpass the capabilities 

H20 of the PSTN. 

There are, however, some drawbacks associated with existing IP 
telephony systems. For example, in VoIP systems, most VoIP clients need to 
connect to a VoIP proxy server in order to complete a call. After the VoIP 
client connects to a VoIP proxy server, the overall system can provide services 
25 for the VoIP client. In conventional systems, many VoIP clients attempt to 
connect to a designated VoIP proxy server at the same time. This increases 
the workload on the designated VoIP proxy server, even though other VoIP 
proxy servers in the VoIP system may have much lower workloads. This 
results in the workload on the VoIP system becoming unbalanced. This occurs 
30 even if the VoIP client connects to VoIP proxy servers connected in a 

conventional round robin manner. Round robin connection does not guarantee 
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that the workload will be equally distributed among the VoIP proxy servers. In 
many instances, the VoIP client lacks information on the workload of each VoIP 
proxy server and is unable to connect to the optimal VoIP proxy server, i.e., a 
VoIP proxy server with the lowest workload. 
5 Therefore, there exists a strong need in the art for a system and method 

which identifies and utilizes the VoIP proxy server with the lowest workload. 
Such a system and method would provide the identity of the VoIP proxy server 
with the lowest workload to the VoIP client in order to more efficiently 
complete the call. 

10 

SUMMARY OF THE INVENTION 

p According to one aspect of the invention, the invention is a Voice-over 

jTj Internet Protocol (VoIP) system. The VoIP system includes a network including 

at least two VoIP proxy servers configured to allow voice data to be 
fin 5 transmitted and received over the network. The VoIP system also includes at 
. least two VoIP clients operatlvely coupled to the network to transmit and 

receive voice data over the network and a load balancing proxy server device 
ry configured to determine an identity of a VoIP proxy server with a lowest 
O workload. The load balancing proxy server device is also configured to provide 
^0 the identity of the VoIP proxy server with the lowest workload to one of the at 
least two VoIP clients so that the one of the at least two VoIP clients can 
connect to the VoIP proxy server with the lowest workload in order to transmit 
and receive voice data in relation to another of the at least two VoIP clients. 
According to another aspect of the invention, the invention is a method 
25 for connecting at least two Voice-over Internet Protocol (VoIP) clients to a VoIP 
system, wherein the VoIP system comprises a network of at least two VoIP 
proxy servers, a load balancing proxy server and a VoIP proxy server which has 
a lowest workload. The method includes the step of determining an identity of 
the VoIP proxy server which has the lowest workload of the at least two VoIP 
30 proxy servers. The method further includes the step of connecting of one of 

the at least two VoIP clients to the VoIP proxy server with the lowest workload 
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in order to transmit and receive voice data in relation to another of the at least 
two VoIP clients. 

BRIEF DESCRIPTION OF DRAWINGS 

These and further features of the present invention will be apparent with 
reference to the following description and drawings, wherein: 

FIG. 1 is a systenn level diagram of a VoIP system including a load 
balancing proxy server according to an embodiment of the present invention; 

FIG. 2 is a detailed schematic flow diagram representing a VoIP client 
connecting to the VoIP system using the load balancing proxy server in an 
embodiment of the present invention; 

FIG. 3 is a flow diagram of a method for employing the load balancing 
proxy server according to the present invention; 

FIG. 4 is a flow diagram of a method for identifying the VoIP proxy 
server with the lowest workload according to an embodiment of the present 
invention; and 

FIG. 5 is a flow diagram of a method for querying the load balancing 
proxy server to connect to the VoIP proxy server with the lowest workload 
according an embodiment of the present invention. 

DISCLOSURE OF INVENTION 

To illustrate the present invention in a clear and concise manner, the 
drawings may not necessarily be to scale and certain features may be shown in 
a partial schematic format. 

The present invention is a VoIP system including a load balancing proxy 
server with which a VoIP client communicates with before it connects to an 
optimal VoIP proxy server, i.e., a VoIP proxy server with the lowest workload. 
Further, the invention includes a method for determining and identifying the 
optimal VoIP proxy server based on a response received from a VoIP proxy 
server as a result of requests to several VoIP proxy servers from the load 



tNMEP0102US 

balancing proxy server. Further, the method includes providing the Identity of 
the VoIP proxy server to the VoIP client so that the VoIP client may connect. 

In one embodiment, when the load balancing proxy server receives a 
request from a VoIP client wanting to connect to the VoIP system, the load 
5 balancing proxy server generates requests to all VoIP proxy servers and awaits 
a response. When the load balancing proxy server first receives a response 
from a VoIP proxy server, the load balancing proxy server immediately cancels 
the other requests. The first responding VoIP proxy server is assumed to be 
the VoIP proxy server with the lowest workload, in response to the client 
10 request, the load balancing proxy server provides the identity of the VoIP proxy 
server to the VoIP client. The VoIP client then connects to the identified VoIP 
proxy server and accesses the VoIP system. Thus, the load balancing proxy 
server balances the workload of VoIP proxy servers. 

Referring initially to FIG. 1, an embodiment of a VoIP system, generally 
15 designated as 10, is shown. The VoIP system 10 includes a digital data 
network over which digitized voice signals are transmitted as a stream of 
packets. The underlying digital data network may be an IP network 12, for 
example, a proprietary network, a network of leased facilities, the Internet, an 
Intranet, a WAN, a LAN, a virtual private network (VPN), an ATM, a T1 
20 network, an El network, an Ethernet, a microwave network, a satellite network 
or the like, or a combination thereof. Within the IP network 1 2 are a plurality 
of VoIP proxy servers, servers #1 through #N, for example. The plurality of 
proxy servers are coupled together, for example, via conventional network 
routing or other means known by those with ordinary skill in the art. A load 
25 balancing proxy server 14 is coupled to servers #1 through #N, for example, 
via conventional network routing or other means known by those with ordinary 
skill in the art. The operation of the load balancing proxy server 14 in relation 
with servers #1 through #N, a transmitting or calling VoIP client, and a 
receiving VoIP client will be further explained below with reference to FIGS. 2- 
30 5. It should be understood that included in the IP network 1 2 will be other 
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network devices to complete the network such as gateways, routers, switches, 
etc. (not shown). 

A plurality of conventional analog phones 1 6 may be coupled to the IP 
network 1 2 via a local PSTN gateway 22. The plurality of analog phones 16 
5 may be part of a local PSTN 20. Thus, the plurality of analog phones 1 6 may 
access the VoIP system 10 locally using known techniques. 

Additionally, various "Session Initiation Protocol" (SIP) phones 18 may 
be coupled to the IP network 1 2 via a SIP gateway 1 9, for example. A 
plurality of IP phones 26 and/or computers 28, for example, may also be 
10 coupled to the IP network 12 via various media gateways 24 and/or various 
y_ routers 30. Additionally, various H.323 phones 32 may be coupled to the IP 
u network 1 2 via an H.323 gateway 34, for example. 

4; Each computer 28 may have, for example, a pair of speakers and a 

J=j microphone (not shown), or may have a headset with a microphone (not 
iwi5 shown). Alternatively, a computer video camera with a microphone may be 
s coupled to the computer 28 (not shown). The computer 28 may be a personal 

computer (PC) configured as a multimedia computer, a mobile computing 
device such as a laptop computer or the like. The computer 28 may execute 
D logic, e.g., software, in order to place a VoIP call. 
20 As will be appreciated, the analog phones 16, the SIP phones 18, the IP 

phones 26, the computers 28, the H.323 phones 32, etc., via their respective 
gateways or routers, represent VoIP clients within the VoIP system 10. The 
VoIP clients are each capable of making and receiving telephone calls via the IP 
network 1 2 by transmitting and receiving digital voice data packets 
25 therebetween. The actual procedures and protocols for exchanging such data 
employs conventional VoIP techniques except as otherwise described herein. 
Thus, the description herein focuses primarily on the inventive aspects. 

Next, the general operation of the VoIP system 10 will be described. As 
previously mentioned, the VoIP system 10 utilizes VoIP technology to allow 
30 voice calls to be originated and terminated on various types of platforms over 
the IP network 1 2. For example, the analog phones 1 6 supported by a 
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conventional PSTN can place and receive calls over the IP network 12. 
Alternatively, a SIP phone 1 8 or an IP phone 26 can place a call to an analog 
phone 1 6 on a local PSTN 20. The local PSTN 20 may be In another city, state 
or country. Further still, a computer 28 can call another computer 28, a SIP 
5 phone 18, an IP phone 26, an analog phone 16, a ceil phone (not shown), a 
satellite phone (not shown) or the like, or a combination thereof. 

In yet another alternative, any of the aforementioned VoIP clients may 
place a call to a VoIP proxy server which hosts special services. For example, 
a VoIP proxy server may host voice mail or video mail. A VoIP client can 
10 connect to the VoIP proxy server to retrieve voice or video mail in an otherwise 
conventional manner. 

1= The VoIP technology translates a destination telephone number into a 

data network address ("IP address") associated with a corresponding 

p." terminating gateway nearest to the destination number. Using an appropriate 

?li1 6 protocol and packet transmission over the IP network 1 2, the terminating 

gateway will transmit the call directly to the VoIP client or initiate a call to the 
destination phone number over the local PSTN 20 at the receiving destination 
to completely establish end-to-end two-way communications. Despite the 
additional connections required, the overall call setup time is not significantly 

h20 longer than with a call fully supported by a conventional PSTN. 

In general, in order to complete a call by accessing the VoIP proxy server 
on the IP network 12, a VoIP client first establishes a connection with the load 
balancing proxy server 14. Next, the VoIP client places a request to the load 
balancing proxy server 14 for the identity of a VoIP proxy server to connect 
25 with in order to complete the call. The load balancing proxy server 14 

proceeds to identify the optimal VoIP proxy server. The load balancing proxy 
server 14 determines and identifies the optimal VoIP proxy server based on 
which VoIP proxy server has the lowest workload. Next, the load balancing 
proxy server 1 4 prepares a response identifying the optimal VoIP proxy server 
30 and transmits the response to the VoIP client which issued the request. Once 
the response is received by the VoIP client, the VoIP client then connects to 



7 



.INMEP0102US 

the VoIP proxy server thus identified In order to establish the call in an 
otherwise conventional manner. 

As a result, the VoIP client wishing to make a call via the IP network 1 2 
first issues a request to the load balancing proxy server 14 to ascertain which 
5 VoIP proxy server #1 through #N is experiencing the lowest workload. The 
VoIP client then establishes the call through that particular VoIP proxy server. 
In this manner, the present invention helps to avoid one or more VoIP proxy 
servers shouldering the majority of the workload while other of the VoIP proxy 
servers are underutilized at any given moment in time. This way, more 
10 optimum network connections may be established for each call, thereby 
reducing latency time, etc. 

In the VoIP system 1 0, voice signals are digitized and transmitted as a 
^ stream of packets over the IP network 1 2. The IP network 1 2 allows each 

packet to independently find the most efficient path to the intended 
1 1 5 destination, thereby best using the network resources at any given instant. 
The packets associated with a single source may thus take many different 
paths to the destination in traversing the IP network 12, arriving with different 
end-to-end delays, arriving out of sequence, or possibly not arriving at ail. At 
the destination, however, the packets are re-assembled and converted back 
.'nZO into the original voice signal. VoIP technology insures proper reconstruction of 
the voice signals, compensating for echoes made audible due to the end-to-end 
delay, for jitter, and for dropped packets, etc. 

Turning now to FIG. 2, the IP network 1 2 is shown enlarged with a 
representative VoIP client 36 (hereinafter client 36) attempting to connect to a 
25 VoIP proxy server in order to complete a VoIP call in accordance with the 
invention. The client 36 may be any device capable of transmitting and 
receiving voice data over a VoIP system. For example, the client 36 may take 
the form of one of the analog phones 16, the SIP phones 18, the IP phones 26, 
the computers 28, etc., which connect to the IP network 12 via its respective 
30 gateway or router. The steps of the call connection process will now be 
further explained with reference to FIGS. 3-5, 
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Referring now to FIG. 3, the overall process is shown for identifying a 
VoIP proxy server on the VoIP system 10 in accordance with the present 
invention. In step 48, the load balancing proxy server 14 receives a request 
from client 36 requesting the identity of the VoIP proxy server having the 
5 lowest workload in order to place a VoIP call. The client request is represented 
by network connection line 44 in FIG. 2. 

In step 50, the load balancing proxy server 14 identifies which VoIP 
proxy server has the lowest workload. Specifically, the load balancing proxy 
server 14 generates and transmits requests to all VoIP proxy servers #1 
10 through #N. Thereafter, the load balancing proxy server 14 awaits a response 
from any of the VoIP proxy servers. When the load balancing proxy server 14 
n first receives a response from a VoIP proxy server, the load balancing proxy 
3 server 14 immediately cancels the other requests. The first responding VoIP 

P proxy server is then assumed to be the VoIP proxy server with the lowest 

D 

iij 1 5 workload and is thus identified by the load balancing proxy server 14. Such 

identification of the VoIP proxy server with the lowest workload is based on a 
N heuristic that the VoIP proxy server #1 through #N which can first respond to a 

m 

fy request should have a lighter workload at the time of receiving the request. 

Next in step 51, the load balancing proxy server 14 responds to the 
20 request from the client 36 by providing the identity of the VoIP proxy server 
currently having the lowest workload. The response from the load balancing 
proxy server 14 that provides the identity of the VoIP proxy server to the client 
36 is represented by network connection line 45 in FIG. 2. The identity of the 
server may be, for example, an IP address or the like which the load balancing 
25 proxy server 14 provides to the client 36. 

Next in step 52, the client 36 connects to the VoIP proxy server 
identified as having the lowest workload using known network protocols, etc. 
For example, in FIG. 2, VoIP proxy server #2 represents the VoIP proxy server 
identified as having the lowest workload. Client 36 connects to the VoIP proxy 
30 server #2 via the network connection line 46, in order to complete the VoIP call 
in otherwise conventional fashion. 
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Now referring to FIG. 4, the specific steps carried out by the load 
balancing proxy server 1 4 for identifying the server with the lowest workload 
will be described. In step 54, the load balancing proxy server 14 is in a 
standby mode awaiting a request from a VoIP client 36 requesting access to a 
5 VoIP proxy server. 

Next in step 56, the load balancing proxy server 14 determines whether 
it has received a request from a client 36. If the answer is "no", then the load 
balancing proxy server 1 4 proceeds to continue to await a request from a VoIP 
client 36 to access one of the VoIP proxy servers as represented by line 58 in 
10 FIG. 4. However, if the answer is "yes", then the load balancing proxy server 
1 4 proceeds to step 60, 
J In step 60, the load balancing proxy server 14 generates call requests to 

O all VoIP proxy servers and awaits a response. Then in step 62, when the load 
m balancing proxy server 14 receives the first response from a VoIP proxy server, 

1 5 the load balancing proxy server immediately cancels the other requests. The 
* first responding VoIP proxy server is assumed to be the VoIP proxy server with 
1=4 lowest workload. 

'fi Next in step 64, the load balancing proxy server 1 4 prepares and 

transmits a packet containing the identity of the VoIP proxy server with the 
y20 lowest workload to the requesting client 36. 

Now referring to FIG. 5, the steps carried out by the VoIP client making 
the call and requesting the identity of the VoIP proxy server with the lowest 
workload will now be described. In step 68, a user of the VoIP system 10 
initiates a call on the VoIP system via a VoIP client (e.g., the analog phones 16, 
25 the SIP phones 18, the IP phones 26, etc.). The user may, for example, pick 
up the receiver of the IP phone 26. Alternatively, the user may execute a VoIP 
program on a VoIP compatible computer 28. Further still, the user may pick up 
a receiver of the analog phone 1 6. In step 70, the VoIP client transmits the 
client request to the load balancing proxy server 14 {represented by network 
30 connection line 44 in FIG. 2). As previously described, such client request 
prompts the load balancing proxy server 1 4 to determine which VoIP proxy 
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server currently has the lowest workload. Next in step 72, the client 36 
receives a packet from the load balancing proxy server 1 4 containing the 
response to the client request including the identity of the VoIP proxy server 
with the lowest workload. The client 36 then proceeds to connect with the 
5 identified VoIP proxy server as represented by line 46 (FIG. 2), in step 74 in 
order to establish the call in an otherwise conventional manner. 

As mentioned above, this method is based on a heuristic that the VoIP 
proxy server which can first respond to a request should have a lighter 
workload at the time of receiving the request. In addition, the "randomness" of 
1 0 proxy response time somewhat guarantees no proxy will be overwhelmingly or 
constantly loaded. Other refinements such as proportioning response time of 
pj VoIP proxy servers to new requests based on their workload can improve the 
O randomness and thus result in a more uniform workload distribution among the 

m proxies. 

Pi 

pi 5 It will further be appreciated that the VoIP system 10 may alternatively 

'P have configurations other than the configurations shown in FIG. 1 . Thus, there 

H has been disclosed a system and method of identifying the VoIP proxy server 

ni 

m with the lowest workload and providing such identity to a VoIP client so the 
j: VoIP client may connect to the VoIP system in order to make a VoIP call. This 
|=a20 method permits the more efficient use of the VoIP proxy servers by balancing 
the workload among the VoIP proxy servers more efficiently. Additionally, 
although the flow charts of FIGS. 3-5 show a specific order of execution, it is 
understood that the order of execution may differ from that which is depicted. 
For example, the order of execution of two or more blocks may be scrambled 
25 relative to the order shown. Also, two or more blocks shown in succession in 
FIGS. 3-5 may be executed concurrently or with partial concurrence. 

It will be appreciated that each of the respective devices described 
herein is programmed via conventional computer programming techniques to 
execute machine-readable code in order to carry out the operations described 
30 herein. Such programming may be easily performed by those having ordinary 
skill in the art of computer programming and IP technology based on the 
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disclosure herein. Accordingly, the particular details of such programming code 
have been omitted for the sake of brevity. 

Although particular embodiments of the invention have been described in 
detail, it is understood that the invention is not limited correspondingly in 
scope, but includes all changes, modifications and equivalents coming within 
the spirit and terms of the claims appended hereto. 



